Skip to content

Consolidate ax/analysis tests (#5007)#5007

Open
eonofrey wants to merge 2 commits intofacebook:mainfrom
eonofrey:export-D95603642
Open

Consolidate ax/analysis tests (#5007)#5007
eonofrey wants to merge 2 commits intofacebook:mainfrom
eonofrey:export-D95603642

Conversation

@eonofrey
Copy link
Contributor

@eonofrey eonofrey commented Mar 10, 2026

Summary:

Part of a 19-diff stack to consolidate repetitive tests across Ax and PTS using subTest. Consolidate 11 test files in ax/analysis/ (plotly, healthcheck, graphviz) — adds subTest to top surfaces, metric summary, search space summary, and summary tests.

Differential Revision: D95603642

@meta-cla meta-cla bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Mar 10, 2026
@meta-codesync
Copy link

meta-codesync bot commented Mar 10, 2026

@eonofrey has exported this pull request. If you are a Meta employee, you can view the originating Diff in D95603642.

@codecov-commenter
Copy link

codecov-commenter commented Mar 10, 2026

Codecov Report

❌ Patch coverage is 99.35897% with 1 line in your changes missing coverage. Please review.
✅ Project coverage is 96.75%. Comparing base (d016302) to head (5bc080e).
⚠️ Report is 2 commits behind head on main.

Files with missing lines Patch % Lines
...hviz/tests/test_hierarchical_search_space_graph.py 85.71% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #5007      +/-   ##
==========================================
- Coverage   96.75%   96.75%   -0.01%     
==========================================
  Files         606      606              
  Lines       66152    66075      -77     
==========================================
- Hits        64007    63931      -76     
+ Misses       2145     2144       -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

eonofrey added a commit to eonofrey/Ax that referenced this pull request Mar 10, 2026
Summary:

Part of a 19-diff stack to consolidate repetitive tests across Ax and PTS using `subTest`. Consolidate 11 test files in ax/analysis/ (plotly, healthcheck, graphviz) — adds subTest to top surfaces, metric summary, search space summary, and summary tests.

Differential Revision: D95603642
@meta-codesync meta-codesync bot changed the title Consolidate ax/analysis tests Consolidate ax/analysis tests (#5007) Mar 16, 2026
eonofrey added a commit to eonofrey/Ax that referenced this pull request Mar 16, 2026
Summary:

Part of a 19-diff stack to consolidate repetitive tests across Ax and PTS using `subTest`. Consolidate 11 test files in ax/analysis/ (plotly, healthcheck, graphviz) — adds subTest to top surfaces, metric summary, search space summary, and summary tests.

Differential Revision: D95603642
eonofrey added a commit to eonofrey/Ax that referenced this pull request Mar 16, 2026
Summary:

Part of a 19-diff stack to consolidate repetitive tests across Ax and PTS using `subTest`. Consolidate 11 test files in ax/analysis/ (plotly, healthcheck, graphviz) — adds subTest to top surfaces, metric summary, search space summary, and summary tests.

Differential Revision: D95603642
eonofrey added a commit to eonofrey/Ax that referenced this pull request Mar 16, 2026
Summary:
Pull Request resolved: facebook#5007

Part of a 19-diff stack to consolidate repetitive tests across Ax and PTS using `subTest`. Consolidate 11 test files in ax/analysis/ (plotly, healthcheck, graphviz) — adds subTest to top surfaces, metric summary, search space summary, and summary tests.

Differential Revision: D95603642
eonofrey added a commit to eonofrey/Ax that referenced this pull request Mar 16, 2026
Summary:

Part of a 19-diff stack to consolidate repetitive tests across Ax and PTS using `subTest`. Consolidate 11 test files in ax/analysis/ (plotly, healthcheck, graphviz) — adds subTest to top surfaces, metric summary, search space summary, and summary tests.

Differential Revision: D95603642
@eonofrey eonofrey force-pushed the export-D95603642 branch 2 times, most recently from 2d991cd to d5214d9 Compare March 17, 2026 00:15
eonofrey added a commit to eonofrey/Ax that referenced this pull request Mar 17, 2026
Summary:

Part of a 19-diff stack to consolidate repetitive tests across Ax and PTS using `subTest`. Consolidate 11 test files in ax/analysis/ (plotly, healthcheck, graphviz) — adds subTest to top surfaces, metric summary, search space summary, and summary tests.

Differential Revision: D95603642
eonofrey added a commit to eonofrey/Ax that referenced this pull request Mar 17, 2026
Summary:

Part of a 19-diff stack to consolidate repetitive tests across Ax and PTS using `subTest`. Consolidate 11 test files in ax/analysis/ (plotly, healthcheck, graphviz) — adds subTest to top surfaces, metric summary, search space summary, and summary tests.

Differential Revision: D95603642
Summary:

Part of a 19-diff stack to consolidate repetitive tests across Ax using `subTest`. Consolidate 8 test files in ax/adapter/ and ax/adapter/transforms/ — adds subTest parameterization to torch adapter, trial-as-task transform, logit transform, and objective-as-constraint tests.

Differential Revision: D95603401
Summary:

Part of a 19-diff stack to consolidate repetitive tests across Ax and PTS using `subTest`. Consolidate 11 test files in ax/analysis/ (plotly, healthcheck, graphviz) — adds subTest to top surfaces, metric summary, search space summary, and summary tests.

Differential Revision: D95603642
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed Do not delete this pull request or issue due to inactivity. fb-exported meta-exported

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants